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The Thouless, Anderson, Palmer (TAP) approach to thermodynamics of mean field spin-glasses 
' is generalised to dynamics. A method to compute the dynamical TAP equations is developed and 

, applied to the p-spin spherical model. In this context we show to what extent the dynamics can 

^ ' be represented as an evolution in the free energy landscape. In particular the relationship between 

^ ' the long-time dynamics and the local properties of the free energy landscape shows up explicitly 

^ , within this approach. Conversely, by an instantaneous normal modes analysis we show that the 

local properties of the energy landscape seen by the system during its dynamical evolution do not 
change qualitatively at the dynamical transition. 

o : 
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If at large times a system relaxes toward the equilibrium state, its dynamics is called "equilibrium dynamics" and 
equilibrium properties as the fluctuation dissipation relation and the time translation invariance hold. In this case 
the departures of the dynamical probability measure from the Gibbs measure vanish at large times, therefore the 
^ 1 relationships between thermodynamics and long-time dynamics are obvious. 

^ ' However there are many physical cases, in which a system remains far from equilibrium also at long times. In the 
following we focus on glassy systems, for which relaxation times become so long at low temperature that these systems 
are not in equilibrium on laboratory time scales 0]. In this case it is important to understand to what extent pure 
static concepts (e.g. the free energy landscape) can be related to the long-time dynamics. 

For thermodynamics the relevant landscape is the free energy one. Different authors |^ proposed that this landscape 
is relevant also for dynamics and can be considered, at least at the simplest level, as the landscape on which the 
Q dynamical evolution takes place. For example for a spin system the landscape for dynamics would be the free energy 
Q as a function of local magnetisations rrn (t) and the dynamical variable would be the set of the averaged (over different 
thermal histories) local magnetisations . At the simplest level the dynamical evolution would be a superposition of 
two phenomena: a gradient descent in this free energy landscape and jumps between different states with a probability 
^ , given by a generalised Arrhenius law: exp{—f3AF), where AF is the free energy barrier between two states. 

' However this is far from obvious and up to now a proof of these claims is not available. The main difficulty is that in 
T-H ' general the free energy landscape is not known and the long-time dynamics is not solved. 

''s]" , This "Landscape Paradigm" |Q] has received a firm theoretical basis in the case of mean field frustrated systems, for 
^ which an analytic solution of the thermodynamics Q and of the asymptotic out of equilibrium regime j^] is in general 
available. 

For these models it was shown that a complicated energy function can lead to a rugged free energy landscape and 
to an infinite number of correlated states. Thouless, Anderson and Palmer (TAP) ^ computed for the Sherrington 
' Kirkpatrick model the free energy as a function of local magnetisations. At low temperature the TAP free energy 
^ ] has an infinite number of minima; each one corresponds to a different possible state. It has been shown that their 
I ■ weighted sum (with the Boltzmann weight) gives back equilibrium results Q. Moreover states are correlated and 
' O organised in a ultra-metric structure. This is encoded in the Parisi's solution |^ and was explicitly shown in the 
S , cavity approach developed by Mezard, Parisi and Virasoro, which is a way to solve the minimisation equations of 
the TAP free energy. 

Furthermore at low temperature these systems remain out of equilibrium also at very large times and their long- 
time dynamical behaviour exhibits non trivial features like violation of the fluctuation-dissipation theorem and ageing 
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In particular for the p-spin spherical model Cugliandolo and Kurchan |9|] showed that, even if the system remains 
^ always out of equilibrium, the long-time dynamical behaviour can be interpreted in terms of some properties of the 
free energy landscape. The most intriguing fact is that the properties of the free energy landscape relevant for long 
time dynamics and thermodynamics are completely different. These results indicate that, at least in this mean field 
case, there is a close relationship between long-time dynamics and the free energy landscape, which therefore has a 
meaning on its own also in an out of equilibrium regime. Besides, we note that a connection between the free energy 
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landscape and the long-time out of equilibrium dynamics is very interesting not only for its theoretical implications, 
but also from a technical point of view. In fact this relationship allows to obtain results about dynamics by a pure 
static computation ]To| , pl| . 

However, the reason of this relationship is not clear. Is the description of the dynamics as an evolution on the free 
energy landscape correct or does something else happens, but always such that the relationship found in Q between 
the asymptotic behaviour and the free energy landscape is satisfied ? 

Up to now an answer to this question has been given only for the zero temperature Langevin dynamics of p-spin 
{p > 2) spherical models In this case there is no thermal disorder, so it is clear that a landscape over which 

the dynamics takes place exists and is the energy landscape (or the free energy one, because at zero temperature 
they coincide). In it was shown that at least at zero temperature the main reason of ageing is the flatness of the 
landscape seen during the long-time dynamics . 

The regularity of the dynamical equations near T — and the interpretation of the asymptotic behaviour in terms of 
TAP free energy |^ seem to indicate that the above scenario might be true also at non zero temperature. However, in 
this description of ageing it is implicitly assumed that at large times a landscape for dynamics should exist and that 
this landscape should be related to TAP free energy. Thus, the question about the relationship among dynamical 
behaviour and free energy landscape arises again. 

In this article we clarify this relationship for the p-spin spherical model. The thermodynamical and the dynamical 
behaviours of this model exhibit strong analogies with the phenomenology of super-cooled liquids, the glass transition 
and the glassy phase . Moreover the dynamical theory of the p-spin spherical model has a close relationship 

[ p5[ with the Mode Coupling theory |16|, which serves as a basis for some theories of super-cooled liquids. For these 
reasons many authors consider that the p-spin spherical model provides a mean field description of the glass transition 
and of the glassy phase. 

For this model the TAP free energy was computed and studied in detail [ p7[[T^ and an analytic solution of the 
asymptotic out of equilibrium regime is available |^,^. To understand the reasons of the connection found in 
between TAP free energy and the asymptotic behaviour, we will compute the equations satisfied by the local 
magnetisations mi{t) = {si{t)) (where (•) means the average over the thermal noises) without performing the average 
over disorder. This is the generalisation to dynamics of the Thouless, Anderson and Palmer approach [Bj. 
We will show that the dynamical evolution of the local magnetisations corresponds to a relaxation in the free energy 
landscape (in a sense which we will precise) only for very large times and for particular initial conditions; in all the 
other cases the dynamics is characterised by a memory term, which makes the evolution non-Markovian. Moreover 
the study of the dynamical TAP equations shows that the stationary points of the static free energy and the free 
energy Hessian in these points are closely related to the long-time dynamical behaviour, as was already found from 
the solution of the equations on the correlation and the response functions in p| pT|pO[ | . Our results explicitly show 
that the scenario for slow dynamics found in [l^ remains valid also at finite temperature: ageing is due to the motion 
in the flat directions of the free energy landscape in presence of a vanishing source of drift. 

Finally we show that already for the simple case of the p-spin spherical model an analysis of the local properties of 
the energy landscape is not adequate to identify the dynamical glass transition. We will compute the spectrum of 
the energy Hessian for dynamical configurations seen during the dynamical evolution. The eigenvectors of the energy 
Hessian are called instantaneous normal modes in liquid theory and have been introduced to represent the short-time 
dynamics of liquids within a harmonic description | |2l[ | . 

We will show that the local properties of the energy landscape seen during the dynamical evolution do not change 
qualitatively at the dynamic al g lass transition but at a higher temperature Tq, which seems to be related to the 
damage spreading transition |22| . This indicates that at the dynamical glass transition the energy landscape seen by 
the system remains locally the same, whereas its global properties change and this can be observed by analysing the 
local properties of the free energy landscape. 

The paper is organised as follows: in section I we derive the static TAP free energy for mean field spin glass models. 
This section serves as an introduction to the method applied in the following to derive the dynamical TAP free energy. 
In section II this method is applied to derive the dynamical TAP equations via the analogy between the dynamical 
theory and a supersymmetric static theory. In section HI the asymptotic analysis of the dynamical TAP equations is 
performed. In section IV the local properties of the energy landscape seen during the dynamical evolution is analysed. 
Finally we conclude in section V. 



I. STATIC TAP APPROACH 



A useful function in the study of phase transitions is the Legendre transform of free energy. This function, which 
can be interpreted as the effective potential whose minima represent different possible states, gives an intuitive (and 
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quantitative) description of phase transitions. Consider for example ferromagnetic systems. In this case the effective 
potential is a function of magnetisation. The ferromagnetic transition corresponds to the splitting of the paramagnetic 
minimum in the two ferromagnetic minima. A vanishing external magnetic field breaks the up-down symmetry and 
fixes the system in one of the two possible ferromagnetic states. 

Generally, frustrated systems are characterised by a complicated energy landscape, which can give rise eventually 
to the existence of many possible states. In this case it is not possible to characterise the states a priori studying 
the various possible schemes of spontaneous symmetry breaking. Thus, the effective potential has to be computed 
as a function of the averaged microscopic configuration and this is what Thouless, Anderson and Palmer did for the 
Sherrington-Kirkpatrick model. They derived the Legendre transform of the free energy with respect to the local 
magnetic fields hi, obtaining the effective potential (called now TAP free energy) which is a function of the local 
magnetisations for a fixed (but typical) disorder configuration. At low temperature the TAP free energy has an 
infinite number of minima; each one corresponds to a different possible state. It has been shown that their weighted 
sum (with the Boltzmann weight) gives back equilibrium results Q found by the replica ||] or the cavity method 

In this section we show how the static TAP free energy can be derived for mean field spin glass models. In this way 
we present in a simple case the strategy which we will follow to compute dynamical TAP equations. The derivations 
of the static TAP equations presented in the literature [ p3|Jl8| seem to be quite often model dependent and rather 
involved. Therefore we hope that this section may be also useful to show an easy way to obtain the TAP free energy 
for a generic mean field model. It does not matter if one considers spherical or Ising spins, two body or many body 
interactions. 

A straightforward way to compute the TAP free energy for mean field (completely connected) spin glass models 
consists in finding a good perturbative expansion such that using the properties of typical disorder configurations it 
is possible to show that only a finite number of terms of the perturbation series does not vanish. 
Following this strategy we will compute the Legendre transform of the free energy with respect to (Si) and X]il=i i^?)- 
One may wonder why we Legendre transform also with respect to X^t^i i'^i}' ^^'^ reason is that otherwise the per- 
turbation expansion would contain an infinite number of terms. 

Note that for Ising spins the average X^i^^i {^1} trivial, so we will Legendre transform only with respect to magneti- 
sations. This is a peculiarity of the Ising spins, which disappears for spherical (or Potts) spins and in the dynamical 
case. 



A. Static TAP equations 

We are finally in position to define the TAP free energy r(/3, rrii, I) which depends on the magnetisation at every 
site i and on the spherical parameter I (for Ising spins I is absent). T is the Legendre transform of the "true" free 
energy: 



f3T{f3,m„l) = lnTr^s,^expi-(3H{{S,})-J2h^{S.-m,)-'-}_^{Sf-l)] . (1) 



For Ising spins Tr|5.i, — } ^^'^ ^^^r spherical spins Tr{5^} = YiiLi '^^i- The Lagrange multipliers hi{0) fix the 
magnetisation at each site i: (Si) — rrii and A(/3), which is present only for spherical models, enforces the condition 
Si=i {^i — l) = 0. (•) denotes the thermal average and N is the number of spins. 
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Once r is known, the equation — 

multiplier as a function of rrii, whereas 
sations. 

In the following we focus on the p-spin Hamiltonian 



— A fixes the spherical constraint (^^ S'f = N) and gives the spherical 



= hi are the TAP equations, which fix the values of local magneti- 

1=1 



Hm}) = - J2 J^U■■■,^A.■■■S^, ' (2) 



l<ii<-<ir,<N 



where the couplings are Gaussian variables with zero mean and average Jf^ ... = ^jvp-i ■ 

The standard perturbation expansion for the generalised potential P is rather involved |^,|l8| and cannot be directly 
applied to the Ising case. Thus, we prefer to follow the approach developed for the Sherrington-Kirkpatrick model by 
T. Plefka and A. Georges and S. Yedidia j26j because is simple and can be directly applied to all mean field spin 
glass models. 
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They obtained the TAP free energy for the Sherrington-Kirkpatrick model expanding —(3T in powers of P around 
/3 = 0: 
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For a general system this corresponds to a ^ expansion {d being the spatial dimension) around mean field theory [p6| ; 
so it is not surprising that for mean field spin glass models only a finite number of terms survives. The zeroth- and 
first-order terms give the "nai've" TAP free energy, whereas the second term is the Onsager reaction term. 
From the definition of — /JF given in equation we find for Ising spins: 
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and for spherical spins|^: 
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These are the entropies of non interacting Ising or spherical spins constrained to have magnetisation 
The linear term in the power expansion (H) of the TAP free energy equals: 
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where the last sum is present only for spherical models. The second and the third term are zero because of Lagrange 
conditions; moreover at /3 = the spins are decoupled so all the thermal averages are trivial: 
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9(/3F 
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(3=0 l<ii<-<ip<N 



(7) 



This "mean field" energy together with the zeroth-order term gives the standard mean field theory, which becomes 
exact for infinite-ranged ferromagnetic system. The Onsager reaction term comes from the quadratic term in the 
expansion (||): 



P^ dHf^Tsj) 
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l<ii<---<i„<N 




P=0 



m,^■■■m^^_^{S^^-m,^) . 

To compute this term we have used the following Maxwell relations: 
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(8) 
(9) 

(10) 
(11) 



'^We are neglecting a useless constant in Fg. A term in Fs, that does not depend on I and m;, has no influence on 
thermodynamics . 
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Using the statistical properties of the couphngs it is easy to check that the only terms giving a contribution of the 
order of iV correspond to the squares of Jii,...,ij,: 



/3=0 



2 
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l<ji <---<'ip<-/V 



r2 . 



2p\ ^ 



Jf. 



I3=Q 



/3=0 



(12) 



Si ) ~ m- 



2\ 2 



Using again the statistical properties of the couplings and neglecting terms giving a contribution of an order smaller 
than N we find that the reaction term depends on rrii through the overlap q = jf only: 
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f3=0 
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(13) 
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Higher derivatives in equation ( M) lead to terms which can be neglected because they are not of order of N [|18|,^ ; so 
collecting (|4|) , (|5|) , (|^) , (p^ and ( [l^ ) we find the TAP free energy for Ising and spherical p-spin models. Deriving the 
free energy with respect to magnetisations m; and the spherical parameter I (in the spherical case) one finds the TAP 
equations. For instance for spherical spins we find: 



P 



E 



l-q (p-iy. ^ 



^p(p-l)qf-2(l-g)m. 



(15) 



1 — g 2 



(16) 



These equations admit for certain temperatures an infinite number of solutions. This is a fundamental characteristic 
and difficulty of mean field spin glasses. 

It has been shown that the weighted sum of the local minima of the TAP free energy gives back equilibrium results 
found by the replica or the cavity method 



E' 



(17) 



where /q. is the TAP free energy of a stable solution {mf } of TAP equations. The different TAP states can be grouped 
with respect to their free energy; then the partition function can be rewritten as: 



Z 



dfe 



-Af(/3/-S(/;/3)) 



(18) 



where NT,{f; (3) is the logarithm of the number of TAP states with free energy / and is called complexity ]27| , |l3| , |l8[ . 
Note that states which do not have the minimum free energy can dominate the sum in (|l^ ) if their number is very 
large. 

Finally, we note that it was crucial to Legendre transform also with respect to ;^ X^iLi otherwise in (|^) the 
derivatives higher than the second order would not vanish and an infinite number of terms should be re-summed. 
This re-summation is automatically achieved if one Legendre transform also with respect to 'Yl!i=i ^1 ■ 



B. A brief survey on the p-spin spherical model 



In the following we recall very briefly some results on the thermodynamics and the dynamics of the p-spin spherical 
model which will be useful for the asymptotic analysis of the dynamical TAP equations. A detailed review has been 
done by Barrat p^. 
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1. The thermodynamics 



The thermodynamics of the p-spin spherical model has been studied within the replica approach in p9| , whereas 
the TAP equations have been analysed in [TtIJi^ . 

It has been shown that there is a high temperature regime T > Td, Td = \J 2(pli)p '^; for which the paramagnetic 
state TTii = dominates the partition function, i.e. Z — g-^^fp^ra. 

There is also an intermediate temperature regime Tg < T < Td in which the partition function is dominated by an 
exponential number (in N) of states, i.e. the related complexity is different from zero. In this case the free energy is 
given by: 

1 ay 

/e, = ,r-^s(r;/3) /3 = ^(r;/3) • m 

Finally, there is a low temperature regime T < in which the sum in (^8|) is dominated by the lowest states in free 
energy. Their number is infinite but not exponential in so the related complexity is zero. 

In the intermediate temperature regime there is a non trivial distribution of states, but the equilibrium free energy 
ifeq) is equal to the paramagnetic one {fpara)- Note that the paramagnetic state does not exist in this temperature 
regime but the equality between f^q and fpara implies that the system seems to be in the paramagnetic phase 
yet. Actually, in the simplest replica analysis this phase is still described by the replica symmetric solution. 
The thermodynamic phase transition is at Ts. At this temperature the one step replica symmetry breaking solution 
becomes stable and for T < Tg the system is in the glassy phase. 



2. The dynamics 

The dynamics of the p-spin spherical model for random initial conditions (corresponding to a quench from infinite 
temperature) has been studied in |^,^ ; whereas the dynamics taking an initial condition, which is a typical equilibrium 
configuration at a certain temperature T', has been analysed in [Tl|j20[ |. 

It has been shown that for random initial conditions, actually the physical case, the p-spin spherical model has a 
transition at Td (which is higher than Ts). Above the dynamical transition temperature there is a coexistence of some 
non trivial TAP states with the paramagnetic state which dominates thermodynamics. Starting from a random initial 
condition the system thermalizes within the paramagnetic state, however an initial condition belonging to a stable 
TAP state leads always to an equilibrium dynamics inside this state. Between the static and the dynamic transition 
temperatures the paramagnetic state is fractured into many TAP states. Starting from a random initial condition 
the system ends up ageing and the asymptotic values of some one time quantities are equal to the corresponding 
ones of the threshold states, which are the highest (in free energy) TAP states. For lower temperatures the static is 
dominated by the lowest TAP states, whereas the dynamics is still dominated by the highest TAP states. 
Moreover the peculiarity of the spectrum of the free energy Hessian for threshold states, which is a shifted semi-circle 
law with minimum eigenvalue equal to zero, has been used to give an interpretation of ageing as the evolution in a 
landscape with many flat directions [p|JT^ . 



II. DYNAMICAL TAP APPROACH 



The dynamics of the p-spin spherical model will be investigated using a Langevin relaxation dynamics. In the 
following we introduce the superspace formalism. Within this compact notation the dynamics and the static theory 
considered in the previous section are formally very similar pC| ] . Therefore dynamical TAP equations can be derived 
straightforwardly generalising the method described in the previous section. 



A. Formalism 



We start by considering a Langevin equation for the relaxation dynamics of spin glass models: 

dsi „dH , . 
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where r]i(t) are Gaussian random variables with zero mean and variance^ (^i(^)^j(^')) = '^Si,jS{t — t'). Note that now 
(•) means the average over the thermal noise. 



Standard field theoretical manipulations |3l| lead to the Martin-Siggia-Rose functional [g2[ for the expectation value 
of an operator 0(s,;): 

N 

{0{s,))= J '[[Vs^Vs^Vc^Vc^e:^p{S{s^,s^,c^,c^))Ois,) (21) 



2J = 1 



dt dsidsj 



where Ci{t) and Ci{t) are Grassmann fields ("ghosts") and Si{t) and Si{t) are commuting fields, Si{t) real and Si(t) 
purely imaginary. Starting from the expectation value of products of the two commuting fields one can construct 
correlation and response functions: 

i—l 2—1 ^ ^ i—1 

where hi{t) is the magnetic field coupled to the spin Si. In superspace | |3l| | the action S can be written in a compact 
form, which looks like a static action. To fix the notation in superspace, we introduce two anticommuting Grassmann 
variables 0,9; the integrals over these variables are defined as: 

de^Jde^o Jdee^Jdee^i . (23) 

We also introduce the (commuting) superfield Sf. 

s,{t,9,e) = s,{t) + ec,{t)+-,{t)e + m^{t) . (24) 

and the notation: 

D = -2 =-261—— + —, (1) = (ti,6ii,^i) . (25) 

In terms of superfields the Martin-Siggia-Rose functional can be written as (see for example fS^Js^): 



JjlvS.e^vl^J dl -f3H{S,{l))-^J2s,il)DSdl) j 



(26) 



where dl — dtdOdO. 

The action S is supersymmetric and the generators of this supersymmetry are: D' = -S= and D = + 6-^. 

The first generator implies in particular that the action 5* is invariant with respect to translations of 6. By using 
the hypothesis that the SUSY is not broken it is possible to show p3[ | that the system is at equilibrium; furthermore 
the Ward identities associated to SUSY imply an equilibrium dynamics and in particular the fluctuation-dissipation 
theorem. The dynamical phase transition of mean field spin glass models is associated to a spontaneously SUSY- 
breaking down to the subgroup of translations with respect to 6 [Q. The initial conditions play for SUSY the same 
role as space boundary conditions in ordinary symmetry breaking. Therefore, different choices of initial conditions 
can lead to different asymptotic behaviours |g,|ll|,|0| . 

In superspace the dynamical theory looks as a static theory for a superfield with an internal coordinate (t, 6, 9) and a 
Hamiltonian H with an extra quadratic term. This similarity with a static theory allows to generalise the expansion 
in powers of [3 described in section I to the dynamical case. 



■^Note that time is measured in unit of temperature. Tlie real time is obtained by multiplying t by the inverse of the 
temperature: tr = I3t. This implies that the variance of thermal noise is equal to 2 for any temperature. 
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B. Dynamical TAP equations 



In the following we focus on the Langevin dynamics of the p-spin spherical model for times not diverging with 
N. Within the static TAP approach one obtains a set of closed equations which, given the magnetic fields hi and 
fixed the spherical condition {I = 1), have to be solved with respect to the local magnetisations and the spherical 
multiplier A. In the dynamical case one has to compute a set of closed equations which, given the magnetic fields hi{t) 
and fixed the spherical condition C{t,t) = 1, have to be solved with respect to the local magnetisations mi{t), the 
spherical multiplier A(t), the correlation and the response functions. This is the natural generalisation of the static 
TAP approach described in section I. As its static counterpart it allows to reconstruct the dynamical TAP free energy 
from a finite number of terms of the perturbative expansion. 

To obtain the TAP dynamical free energy we apply the method of section I to the logarithm of the functional ([2^): 
so we Legendre transform with respect to the (super)magnetisations Mi(l) = {Si{l)) and the two point function 
C(l, 2) = ('^i(l)'5'i(2))- The physical quantities mi{t), C{t, t') and R{t, t') are all encoded in these superspace 

functions. 

The dynamical TAP free energy is: 

N 

- /JTi, = In m VS, exp(-/:' - C") (27) 

r 1 ^ /■ 

l<ii< - <ip<N i=l 

^" ^ h^T. H^{l){S,{l) - M,{1)) + 2 E / dld2K{l, 2)(5,(1)5,(2) - C{1, 2)) , 

i—l i—1 

where A(l, 2) = D(^i-f6{l — 2) and the delta function is defined in the following way: 

S{i - 2) = 6{h - t2)s(ei - d2)S{0i - 02) - s(ti - t2){ei - 02)(0i - 02) . 

The Lagrange parameters Hi{l) and A(l, 2) fix respectively the (super)magnetisation at each site i: {Si{l)) — Mi{l) 
and the two point function C(l, 2) = ;i- J^^^i (5'i(l)S'j(2)). 

As we noted in the previous paragraph it is very important to specify the initial conditions. We take as initial 
condition a fixed configuration {s^}; it does not matter if {s^} is correlated or not with the couplings, because we do 
not average over disorder. In appendix A we show how to take into account the initial condition in the derivation of 
the dynamical TAP equation. For the sake of clarity in the following this problem will not be addressed. 
As in section I, we construct Td through its power expansion in /3 around /3 = 0: 



d'^iPTD) 



n=0 ^ 



13=0 



(28) 



The dynamical TAP equations are the Lagrange relations obtained from Tjj: 



'^^"^ , 4t^=A(M) . (29) 



5Nh{l) ' ' N5C{1,2) 

Since for /3 = the dynamical theory is Gaussian, the zeroth order term of (p8|) reduces to: 



I3=Q 



= ^Tr[\niC - Q)] - ^ J dld2A{l,2)C{l,2) , (30) 



where Q(l, 2) = Xli=i Mi{l)Mi{2) is the (super)overlap function. The linear term in the right hand side of ( |2^ ) is 
a straightforward generalisation of its static counterpart (^: 
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d(3 



P=0 l<ii<-<ip<N 
N 



(31) 



-f3 J dlY^ 

i 

-/3 / dld2 



dp 
5A(1,2) 



(5.(l)-M,(l))^^o 



I3=Q 



dp 



N 



^ (5,(1)5.(2) -C(l,2))^^o . 

13=0 «=1 



As in section I the Lagrange conditions imply that the last two terms are zero. Since spins are decoupled at /3 = 0, 
(pi|) simplifies to: 



P 



diPTo) 



dp 



f3=0 



(32) 



l<ii<---<ip<N 



The analogy with the static case is evident also for the reaction term: 

2 c 



P^ d^iPTo) 



2 dp^ 



2 



. l<!i < - <ip<A'' 



(33) 



/3=0 



1 ,---,«p 



dl 



J, 



(1) • ■ ■ W " (^n (1) - (1)) M., (1) • • • M,^ (1) 

M.,(1)...AV,(1)(5,J1)-M.^(1)) . 



To obtain the equation (p3) we have used the following Maxwell relations: 



dHAl) 



dp 
dk{l,2) 



5 dipVo) 



dp 



13=0 



P=0 



SA'U{1) dp 



f3=0 

2 S dipVo) 



AT (5(7(1, 2) dp 



(34) 

(35) 
(36) 



i3=n 



Using the statistical properties of the couplings it is easy to check that only the terms which correspond to squares of 
Jii,i2---,ip Si^6 a contribution of the order of N and that the reaction term depends on the two point function C(l, 2) 
and the (super)overlap Q{1, 2) only. Therefore we find that the dynamical reaction term reduces to: 



P' d^iPTo) 



2 dp^ 



P^N 



/3=0 



dld2 



C(l, 2Y - Q(l, 2Y - p (C(l, 2) - Q(l, 2)) Q(l, 2)^"! 



(37) 



As in section I higher derivatives in equation ( Pq ) can be neglected because they do not give a contribution of the 
order of N; so collecting expressions (|30|) , (p^) and (|3^) we find the dynamical TAP free energy: 

~ (PTd) = ^Tr[ln{C - Q)] - ^ J dld2A(l, 2)C(1, 2) + (38) 

+Pfdl J^,.■■■,^pM^,{l)■■■M^^{l) + 

dld2 [(p - 1)Q(1, 2)f - pC{l,2)Q{l, 2)P-i + C(l, 2)P . 
The dynamical TAP equations are obtained by the two Lagrange relations ( ^ ) : 

6(1 -3)^Di (C(l, 3) - g(l, 3)) + fd2 [a(1, 2) - (C(l, 2)p-^ - Q{1, 2)p-^) ] (c(2, 3) - Q(2, 3)) , (39) 



P^N 



9 



i^iM,(l)+ /'d2A(l,2)Af,(2) J2 J^,^2,■■■,^,M,,{1)■■■M,^{^)- (40) 



l<i2<---<ip<JV 



d2 



(p - 1) 2) - Q(l, 2)) g(l, 2^-2 - 2)^-' - Q(l, 2)^-1) M,(2) 



where /i = and the prime means that the sum does not run over i. Note that the last term of (|4^) vanishes for 
p = 2. This is natural because for p = 2 the dynamical theory is Gaussian. 

C. Solution respecting causality 

A priori the dynamical TAP equations (39) and ( ^ ) may admit many different solutions, which can break partially 
or completely the symmetries of the action (p2|). Up to now only the solution respecting causality^ jsj] has been 
studied. The others solutions are instantons, related to barrier crossing JP5[ . In the following we focus on the causal 
solution, which breaks only partially the invariance of the action ( |2^ ) [|30|. The unbroken symmetries allow to find 
the general form of this solution : 

M,(l)=TO,(t) (41) 

C{l,2) = C{h,h) + i9i-e2)i9iR{t2,h)-92R{h,t2)) . (42) 
The spherical constraint C(l, 1) = 1 is fixed through A(l, 2), which has the usual form | |30| |: 

A(l,2) = <5(l-2)A(ii) , (43) 

where X(t) is a real function of time. 

Plugging these expressions in the dynamical TAP equations (|3^) and (|4^), we find that the magnetisations and the 
correlation and the response functions satisfy for t > and t' > Q the following equations: 

^ (C{t, t') - Q{t, i')) - t) - X{t) (C{t, t') - Q(t, t')) + (44) 



+/i j dt" (C{t, ff-' - Qit, t'y^ R{t', t") 

+^i{p~l) f dt"{c{t",t')-Q{t",t')^R{tX)c{tXY^^ , 



^R{t, t') = -X{t)R{t, t') + 5(t - t') + (45) 
at 



ti{p-l) / dt"R{t,t")R{t",t')C{t,t")P~^ 



iwt + ^^^^) " ^'''^^^ ^ "^''^ 

^ ^ l<i2<...<ip<N 

+Kp - 1) /* dt" (C{t, t")P-^ - Q{t, t")^-')) R{t, t")m,(t") 



m,,{t)---m,^{t)+ (46) 

2<...<i 

t 



ji—'. 

correlation function satisfies the boundary condition C(t, 0) = Q(t, 0) and magnetisations fulfil the initial conditions 



where Q{t, t') = J2iLi '>Ti'i{t)'nii{t') is the overlap function and hi{t) is the magnetic field acting on the ith spin. The 



^There is only one solution respecting causality. 
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mi(0) = s° (see appendix A). 

Moreover the spherical condition C{t, t) — 1 fixes A as a function of time through the equation: 



A(t)(l-<z(t)) =l + i§+A*^ dt"{c{t,t"r-'-Q{t,t"r-')R{tX)+ (47) 
+^l{p-l) f' dt"(^C{t",t)-Q{t",t)'^R{t,t")C{t,t")P~^ , 



where q{t) — Q{t, t). 

In the following we show that starting from (Q), (p5|), (^) and (^) one can obtain the dynamical equations of |^ 
as a particular case. Actually, if one takes as initial condition for the dynamical measure an uniform average over all 
possible configurations as in |^ , then the magnetisations are equal to zero at i = and there is no boundary condition 
on the correlation function(see appendix A) . In this case we find that the equation (^6|) is trivially satisfied and the 
equations (44), ( |45| ) and ( p7[ ) reduce to the ones considered in 



Furthermore it is easy to verify that at zero temperature ( [46D coincides with a simple gradient descent, as should 
be because the thermal noise is absent; to handle the zero temperature limit we write (|4q ) in terms of the real time 
tr = finding 

d - \ ' 

+ \{tr)\ mi{tr) = hi{tr) + ^ Ji.ij ,. ■ ■ ,ip ™i2 (*r-) ' ' ' (^r ) + (48) 

*" < {C{tr, t';)P-^ - Q{tr, t'lf-^)) R{tr, Om,{t';) , (49) 



P{P - 1) 

2 







where A = ^. For T = ^ = the last term in equation ( |4^ ) is zero because without thermal noise Q{tr, 4) — G{tr, tj,). 
Therefore we recover the zero temperature limit of the Langevin equations: a pure gradient descent in the energy 
landscape. 

In summary for the solution respecting causality we have derived the dynamical TAP equations (^J), (^5|), ( |4^ ) 
and (ji^). These equations on the correlation and the response functions and on the local magnetisations have to be 
solved for a given realization of the couplings and for a given initial condition. 

Note that the equations on local magnetisations do not have the form of a gradient descent in the free energy landscape 
because the Onsager reaction term is non-Markovian. This is natural because it represents the contribution to the 
effective field of the ith spin due to the influence at previous times of the zth spin on the others. 

III. ASYMPTOTIC ANALYSIS 

In the following we perform an asymptotic analysis of the equations (^), (|45|), (|4^ ) and (^7|). For the sake of 
simplicity we will take hi{t) = in (^). 

Two asymptotic behaviour have been found for the p-spin spherical model depending on the choice of the initial 
conditions (|,|l3,|§: 

• True ergodicity breaking: the system equilibrates in a separate ergodic component. Asymptotically time homo- 
geneity and fluctuation-dissipation theorem (FDT) hold pT| , pO[ . 

• Weak ergodicity breaking^: the system docs not equilibrate. Asymptotically two time sectors can be identified. 
In the first one (FDT regime), which corresponds to finite time differences |t — t'| ^ 0(1), {t >> 1, t' >> 1), 
the system has a pseudo-equilibrium dynamics since FDT and time translation invariance hold asymptotically. 
In the second one (ageing regime), which corresponds to "infinite" time differences |t — i'| ~ t', FDT and time 
translation invariance do not apply and the system ages ||] . 

These two dynamical behaviours correspond to different Ansatze for the asymptotic form of the two time quantities. 
Following pj]j20[ | we take for the equilibrium dynamics in a separate ergodic component the Ansatz (i > t' >> 1): 



The concept of weak ergodicity breaking was introduced in 
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Cit,t') = Cfdt (t-f) , R{t,t')= Rfdt (t~t') (50) 

RFDT{r)^-e{T)'^^^^^^ , Q{tX)^q (51) 

\im CFDT{T)=q. (52) 

T — >00 



In the case of slow dynamics we take for finite time separations the Ansatz corresponding to equilibrium dynamics, 
but with Q{t',t) — q' . The difference between q and q' already indicates that the dynamics is not characterised by a 
true breaking of ergodicity and that the system does not equilibrate in a separate ergodic component. Whereas for 
the ageing sector we take the AnsatzQ ^ : 

tRit,t') = RagiX) (53) 
Q{t,t')^q'Qag{X) (54) 

A=y, (55) 

where x parameterises the violation of FDT. Note that in the usual case the overlap function is not present. 

In the next sections we will follow this strategy: assuming some properties on the dynamical evolution we will analyse 

the asymptotic solutions which are consistent with this assumption; then following the physical picture associated to 

each asymptotic solution we will propose which are the initial conditions related to this asymptotic solution. 

The matching between asymptotic behaviour and initial conditions is a general problem in mean field spin glass 

dynamics; up to now there are no analytical methods available and one has to resort to numerical integration of the 

dynamical equations. Nevertheless in our case the integro-differential character of the dynamical equations and their 

number (2 equations on two time quantities and N equations on one time quantities) makes difficult to reach very 

long times. 



C{t,t') = qCagiX) 
Rag{X) = Xq — 

Cag{l) = Qag{l) = 1 



A. Equilibrium dynamics 

In this section we assume that the system has an equilibrium dynamics and we analyse all the asymptotic solutions 
which are consistent with this assumption. 

We denote respectively by X°° and mf^ the asymptotic values of the spherical multiplier and of the local magnetisations. 
Plugging the equilibrium dynamics Ansatz into (|4^) and (^) wc find that the equations on and X°° are the static 
TAP equations (^5|) and (p^). In the asymptotic limit the equations (^4|) and (^) on the correlation and the response 
hmctions reduce to: 

(^^ + - ^?j c{t) + ^i + l-x°^ = -fi£ dT'c{T - T'f-'^^^ ■ (56) 

The above equation describes the equilibrium dynamics inside the ergodic component associated to a TAP solution 
{m?°}. Note that this asymptotic dynamical solution is consistent with the assumption of an equilibrium dynamics 
only if {m°°} is a local minimum of the free energy. 

As we have remarked before, the asymptotic analysis does not give any information about the relationship among 
initial conditions and asymptotic solutions. However, since this asymptotic solution represents the equilibration in a 
stable TAP state {m°°}, it is quite natural to associate to this solution an initial condition belonging to this state. 
This interpretation is suggested by the results of ||l^,|2^. Indeed in ||ll|,^ the low temperature dynamics has been 
studied starting from an initial condition thermalizcd at a temperature T" between the statical and the dynamical 
transition temperatures. This procedure corresponds to take an initial condition belonging to the TAP states, which 
are the equilibrium states at the temperature T'. In [ pTp^ it has been shown that the system relaxes in the TAP 
states associated to the initial condition. It is easy to show that the equation satisfied by C(t) in ||ll|,0 can be 
written in the form (|56|). 



^The asymptotic equations are obtained neglecting the time derivatives. This has as a consequence that from an asymptotic 
solution we obtain infinitely many others by re-parameterisation [^. For the sake of clarity in the following we focus on the 
particular parameterisation shown in equations (pSl), (M) and (M) . 
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Besides, to elucidate how dynamical quantities approach their asymptotic values, we write equation ( p^ ) in a more 
appeahng form: 

(57) 



q)) TTii + 

Q{t,t"f-^))R{t,t")m,{t") , 

where Ts is the static TAP free energy and f{t) and h!^{t) are functions going to zero at large times. 
The equations (|4^) show that the dynamical evolution of magnetisations looks like a gradient descent in the free energy 
landscape but with an extra spherical multiplier f{t) and magnetic fields h^{t) correlated with the initial condition. 
As it should be for an equilibrium dynamics, all quantities are characterised by an exponential relaxation (to zero 
for f{t) and h\{t)), therefore it is not possible to identify any slow or fast variables and the reaction term remains 
non-Markovian at all time (except t = oo). Anyway the interpretation of this asymptotic solution as an equilibration 
in a TAP state shows up explicitly from (p7|). 

In summary, for an asymptotic solution corresponding to an equilibration in a stable TAP state the dynamical 
probability measure relaxes exponentially fast toward the equilibrium measure associated to this state and at large 
times the evolution of the local magnetisations looks like a gradient descent in the free energy landscape, but with 
the extra spherical multiplier f{t) and the magnetic fields h[{t) going to zero. 



ami _ ^ dVs 
dt dnii 



f{t)m, + f]h[{t) 



fit) 



1 



ph'^{t) = -^L{l-qP~^-{p-l)qP-^{l- 

+^l{p-l) f dt" {c(t,t"Y-^ - 



B. Non equilibrium dynamics 

1. Weak ergodicity breaking 

In the following we assume that the system has a slow dynamics with q ^ q' . As we already pointed out the 
difference between q and q' marks that the system does not equilibrate in a single ergodic component. 
The asymptotic analysis in the time sector corresponding to finite time differences leads to the same equation ( |5^ ) for 
the correlation and the response functions. Whereas for infinite time differences we find that the asymptotic equations 
admit the solution: q' ^ 0, q which coicides with the overlap of the threshold states |T7|JT^ ], x — '-p^^^^^~'>'> and Cag{X) 
and Rag{)^), which satisfy the same equations found in 

The equation (p7| ) on the spherical multiplier reduces to: A°° = (1 — q)^^ + /i(l — q^^^) and the asymptotic value 
of the local magnetisations m°° is zero. This is exactly the same asymptotic solution found in ||^ for random initial 
conditions. Therefore it is natural to associate to this solution a random initial condition, which is not correlated 
with any particular stable TAP state. 

To study how the local magnetisations vanish at large times, the "mean field" energy term in ( ^ ) can be neglected 
because is of the order of m^"^. Moreover we can substitute to all terms which multiply mi their asymptotic values, 
finding that reduces to: 

(^^^+X°"^m,{t)=^l{p-l) j\t''Cit,t'')P-^R{t,t'')m,{t'') . (58) 

This is exactly the same equation satisfied by C{t,t') and R{t,t') for a fixed and finite t' and a very large value of t 
. As a consequence the local magnetisations and (for a fixed t') the correlation and the response functions go to 
zero at large times in the same way and because of the same mechanism: fixed any configuration reached during the 
dynamics, two different typical noise histories bring the system in two completely uncorrelated configurations |37| . 

Besides, we remark that the local magnetisations vanish at large time, whereas the correlation function tends in the 
FDT regime to the overlap of the threshold states. This seems to indicate that the dynamical measure tends toward 
(for the one time quantity) a static measure which is broken in separate components, i.e. the threshold states. In 
other words and more formally the fact that the overlap function Q(t,t') tends to zero and the correlation function 
tends (in the FDT regime) to the overlap of the threshold states implies that the dynamical probability measure is 
not a "pure" probability measure, because the clustering in time is not valid in the FDT regime. 
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2. Between true and weak ergodicity breaking 



In the following we assume that the system has a slow dynamics such that Ihnt^oo CpDTit) — 
linit^oo i-e- q = q'- 

The asymptotic analysis in the time sector corresponding to finite time differences leads to the same equation (|5^ ) 
for the correlation and the response functions. Whereas for the "infinite" time difference sector {\t — t'\ ~ t') we find 
that the asymptotic equations admit the solution: 

Qag{X) ^ CagiX) x = ^^^^ , (59) 

where Rag{X) and Can (A) satisfy the same equations found in q = q' satisfies the equation for the overlap of the 
threshold states ]T7| , p^ : 

^ fW'-'il-qf , (60) 



p-1 



and the equation (47) on the spherical multiplier reduces to (^^. The previous results, in particular that the corre- 
lation and response functions fulfil the equation of the equilibrium relaxation dynamics inside a threshold state and 
the equality between q' and qthreshoid, indicate that at very large times the system has almost thermalizcd within a 
threshold state. 

Note that the asymptotic form of ( p4| ) is automatically verified for QagiX) = Cag{X)', whereas ( ^ ) coincides in the 
asymptotic limit with the the first one of the two coupled equations on Cag(A) and Rag{\) found in Another 
equation is obtained applying to (Hfl) the Martin-Siggia-Rose approach. This allows to average over the couplings and 
to obtain another equation on Qag{X) and Rag{X). As expected, if one takes Qag{X) = Cag{X) this equation coincides 
with the second one verified by Cag(A) in ||]. 

Therefore we have found that this asymptotic solution is very similar to the one associated to random initial con- 
ditions. The only difference is that for the latter the local magnetisations vanish because of the spreading of the 
dynamical probability measure at finite times. As we have suggested in the previous section, it seems that the dynam- 
ical probability measure (starting from random initial conditions) tends toward a static probability measure which is 
broken in separate components, i.e. the threshold states. Whereas for the asymptotic solution studied in this section 
the effects due to the spreading of the dynamical probability measure are absent and the system seems to equilibrate 
(in the FDT time regime) within a threshold state. As a consequence it seems natural that the initial conditions 
related to this asymptotic solution are the configurations typically reached in the long-time dynamics (starting from 
a random initial condition). 

In fact a way to obtain this asymptotic solution starting from a random initial condition is to introduce fields hi[t) 
which enforce the condition limt_i.oo ™i(0^ = <?' = qth- There are many different way to fix the fields hi{t) 

to enforce this condition; however for each realization of hi{t) it is clear that limt^oohi{t) = 0, because the condition 
q' = qth is automatically verified in the long-time limit. The spreading of the dynamical measure is due to the 
many possible paths that the system can follow in the energy landscape. A particular realization of the noise brings 
the system along a particular path. The role of the magnetic fields hi{t) is to avoid the spreading of the dynamical 
measure: a particular realization of hi{t) brings the system along one of the possible paths. 

Recently Franz and Virasoro have developed an interpretation of the equality between the fluctuation dissi- 
pation ratio (x, see eq. (|5^)) and the rate of growth of the complexity close to the asymptotic state in terms of 
quasi-equilibrium concepts. In particular they have introduced the notion of quasi-equilibrium state. The local mag- 
netisations of a quasi-equilibrium state are defined for a fixed thermal noise as ^^: rnf~'^'^(i) = l/r J*_^ Si{t')dt' , 

where r is such that C{t,t ~ t) — qth- The analysis of the equations of motion for ra1^'^'^{t) confirms and 
strengthens the previous interpretation of hi{t). 

In the following we analyse the slow evolution of local magnetisations. Note that since the overlap and the correlation 
functions are equal in the ageing regime, one can obtain the slow dynamical behaviour of the correlation and the 
response functions starting from the evolution of mi{t) . 

As in the previous section the equations on the local magnetisations can be rewritten as a gradient descent in the free 
energy landscape with the extra spherical multiplier f{t) and the extra magnetic fields h[{t) going to zero at large 
times. Therefore (^7|) implies that 

hm^(m,(<)) = . (61) 
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Thus, even if the analysis of the FDT regime shows that at very large times the system has almost thermalized 
within a threshold state, the fact that the overlap function shows an ageing behaviour implies that magnetisations 
do not tend toward a particular threshold state. In other words the local magnetisations continue to evolve forever 
(even if more and more slowly) and their large time limit does not exist. This already happens for the spherical 
Sherrington-Kirkpatrick model, for which an exact analytical solution is available |^ . 

As it is implicitly contained in the slow dynamic assumption, the local magnetisations are (asymptotically) constant 
on time-scales associated to the FDT regime and their evolution is on time-scales associated to the ageing regime. 
Because of almost flat directions f{t) and h'^{t) play a fundamental role and are responsible for ageing. In fact at 
large times the dynamics takes place only along almost flat directions and these vanishing function of time act as a 
vanishing source of drift, so the larger is the time, the weaker is the drift and the slower is the evolution: the system 
ages. 



C. Free energy landscape and long-time dynamics 

At finite times the dynamics cannot be represented as an evolution in the free energy landscape because the Onsager 
reaction term in (^6|) is non-Markovian. 

Only in the asymptotic time regime it is possible to establish a connection between the free energy landscape and the 
dynamical evolution. 

When one takes an initial condition which leads to an equilibrium dynamics, i.e. the equilibration in a stable TAP 
state {m°°}, the equations on the local magnetisations imply that the relaxation of {mi{t)} toward {mf^} coincides 
with a gradient descent in the free energy landscape with an extra spherical multiplier and magnetic fields going to 
zero at large times. 

However, in the most interesting and the most physical case of random initial conditions the local magnetisations 
vanish at large times. Thus, the dynamical evolution is dominated by the threshold states, but the asymptotic 
evolution of the local magnetisations does not show any indication of this. 

This result can be understood thinking to a Langevin dynamics in a double well potential V{x). At large times the 
dynamical probability measure is equally distributed on the two wells, therefore the mean position {x{t)) is zero. As a 
consequence the mean position gives a very poor description of the probability measure; whereas the second moment 
{x(t)x{t')) gives more insight into the probability distribution. The same thing happens for the p-spin spherical 
model for random initial conditions: the local magnetisations {si{t)) vanish at large times and do not give a good 
representation of the asymptotic dynamical probability measure, whereas the two time quantities C{t, t') and R{t, t') 
do. 

However, a description of the asymptotic dynamics as an evolution in the flat directions of the free energy landscape 
makes sense. To avoid the previous problem, i.e. the spreading of the dynamical measure, one can take as initial 
condition a configuration typically reached in the long-time dynamics^ 

In this case the correlation and the response functions have the same asymptotic behaviour that for a random initial 
condition. Moreover C{t,t') and Q{t,t') are equal in the ageing time regime. Thus, the ageing dynamics obtained 
starting from a random initial condition can be represented in terms of the equation (|57|), i.e. as a motion in the flat 
directions of the free energy landscape. 

In summary we have found that the representation of the long-time dynamics as an evolution in the free energy 
landscape is correct. This evolution consists in a gradient descent in the free energy landscape with an extra spherical 
multiplier and extra magnetic fields going to zero at large time. These vanishing sources of drift depend on the history 
of the system and are crucial for slow dynamics. 



IV. INSTANTANEOUS NORMAL MODES ANALYSIS OF THE ENERGY LANDSCAPE 



In this section we analyse the local properties of the energy landscape seen by the system during the dynamical 
evolution. In particular we carry out a computation of the spectrum of the energy Hessian for a typical dynamical 
configuration. The eigenvectors of the energy Hessian are called Instantaneous Normal Modes and they have been 
introduced in liquid theory to represent the short time dynamics within a harmonic description. 

To be more specific, consider the energy Hessian of the p-spin spherical model: 



In the analogy with the double well potential this procedure is equivalent to take the initial condition in one of the two wells 
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and the density of states 



P{P - 1) 



E 



Ji,j,i3,...,ipSi3 • • ■ Sip 



(62) 
(63) 



N 



(64) 



where fj,a is an eigenvalue of (|62|), (•) means the average over the dynamical configurations at time t and the over- line 
indicates the average over the couplings. As we will show in the following, p{fi; t) is a self-averaging quantity; therefore 
the typical and the average value of p{fi; t) are the same (in the large-N limit). 
Now we present a sloppy derivation of p{p;t), a more careful derivation is shown in appendix B. 

Since the density of states of E and the spectrum of the energy Hessian (|6^) are related by through a translation, 
in the following we focus on E. 

To compute the correlation functions of the elements of E one can safely assume that the configurations Si are 

uncorrelated with the couplings at the leading order in N, finding: 



i<j,k<l. 



Where is equal to 



pip - 1) 



E 



E 



■ Si„ S 



3p) 



P{P - 1) 



n 2 



NP- 



P 



(* < j) 



(65) 
(66) 

(67) 
(68) 



The matrix E is nothing else that a Gaussian random matrix with variance N"^ ^ . Therefore its typical (and average) 

density of states (see for example |Q ) is a semi-circle law centred in with support [— y^2p(ji — 1), 2p(ji — 1)] . As a 
consequence the spectrum of the energy Hessian (62) equals: 



p(m; t) 



TTp{p - 



I2p{p-l) 



p J 



(69) 



At large times \{t) converges to its limiting value A°° and p{p;t) converges to p°°{p), which is obtained replacing A° 
to X{t) in (69). In the following we consider the dynamics starting from a random initial condition. In this case A° 
verifies the following equation: 



- = + ^(1-.-^) 



(70) 



where q is equal to zero for T > Td and fulfils the equation ( |60| ) of the overlap of the threshold states for T < Td, 

- / p(p-2)p-" 

~ \l 2()9-l)P-i ■ 

In fig.l the left edge [Xmin) of the spectrum p°°{p) is plotted as a function of /3 = l/T forp = 3. At very high temper- 
ature all the eigenvalues are positive because the energy landscape seen by the system is dominated by the quadratic 
potential which fix the spherical constraint. In this regime decreasing the temperature the energy landscape seen by 
the system becomes more and more rugged and the minimum eigenvalue decreases and becomes negative. On the 
other hand at very low temperature there is a finite fraction of negative eigenvalues. In this case if the temperature 
decreases then the minimum eigenvalue of the energy Hessian grows and equals zero at zero temperature, as it is 
expected for a dynamics in a rugged energy landscape. 

Therefore analysing the left edge of p°°{p) we have found a crossover from a high temperature regime in which the 
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FIG. 1. Left edge {Xmin) of the spectrum p°°{fJ^) as a function of the inverse temperature /? — 1/T for p = 3. l//3d is the 
dynamical glass transition temperature, whereas l//3o is the temperature at which Xmin reaches its minimum value and is 
related to the damage spreading transition. 



system is substantially confined in a harmonic potential and a low temperature regime in which the ruggedness of 
the energy landscape seen by the system during the dynamical evolution becomes more and more relevant. We can 
interpret the temperature at which Xmin reaches its minimum value as a crossover temperature Tq = 1/Po = \/p/2 
between these two temperature regimes. It is quite interesting to note that To has a relationship with the damage 
spreading transition p^ . 

In fact it has been shown in that the p-spin spherical model exhibits a damage spreading transition at a temper- 
ature Tds, which satisfies the inequality: \/p/2 — 1 < T^s < This result shows that the temperature To arising 
in the study of local properties of the energy landscape is related to the damage spreading transition temperature 
T^s- This is quite natural because the damage spreading is a probe for the ruggedness of the energy landscape. 
Following it is interesting to note that for high values of p Tds (~ ■\/p/2) is much above the temperature Ttap 
(~ v^Iogp) where an exponentially large number of states appears. As a consequence the origin of damage spreading 
is purely dynamical and not related to TAP states. 

In fig.l we have also indicated the dynamical transition temperature Td — 1/ (3d- The density of states does not 
change qualitatively when the temperature crosses Td'. a fraction of negative eigenvalue is present at Td and vanishes 
for T going to zero. Therefore there is no sign of the dynamical transition in the behaviour of the density of states of 
instantaneous normal modes. 

In summary, we have shown that the damage spreading transition seems to be related to a change in the local 
properties of the energy landscape seen by the system during the dynamical evolution. Conversely, the local properties 
of the energy landscape do not change qualitatively at the dynamical glass transition. At the dynamical glass transition 
the energy landscape seen by the system remains locally the same, whereas its global properties change and this can 
be observed by analysing the local properties of the free energy landscape. 



V. CONCLUSION 



In this paper the Thouless, Anderson and Palmer approach to thermodynamics of mean field spin glasses has been 
generalised to dynamics. We have shown a procedure to compute dynamical TAP equations, which is the generalisation 
to dynamics of the ^ [d being the spatial dimension) expansion developed by A. Georges and S. Yedidia This 
method has been applied to the p-spin spherical model. In this context we have focused on the interpretation of the 
dynamics as an evolution in the free energy landscape. 
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We have shown that at finite times the dynamics cannot be represented as a gradient descent in the free energy 
landscape, because the reaction term in the dynamical TAP equation is non-Mar kovian. 

However, the long-time dynamics can be interpreted as an evolution in the free energy landscape. Actually, for initial 
conditions belonging to stable TAP states the long-time evolution of local magnetisations coincides with a gradient 
descent in the free energy landscape with an extra spherical multiplier and extra magnetic fields going to zero at large 
times. For random initial conditions the local magnetisations vanish asymptotically because at any finite time two 
diff'erent typical noise histories bring the system in two completely uncorrelated configurations | |37[ |. However, also in 
this case, a description of the long-time dynamics as an evolution in the free energy landscape makes sense, providing 
that the effects due to the spreading of the dynamical probability measure are separated from the slow motion of the 
system. In particular we have explicitly shown that slow dynamics is due to the motion in the flat directions of the 
free energy landscape in presence of a vanishing source of drift. 

These results clarify and strengthen the relationship between long-times dynamics and local properties of the free 
energy landscape, which was already found in [p yTl| , |20| , ^ . 

Moreover we have shown that the local properties of the energy landscape seen during the dynamical evolution do 
not change qualitatively at the dynamical glass transition but at a higher temperature To, which is related to the 
damage spreading transition |22[ . This indicates that at the dynamical glass transition the energy landscape seen by 
the system remains locally the same, whereas its global properties change and this can be observed by analysing the 
local properties of the free energy landscape. 

Finally, we remark that there is still an important question which remains open and which has been clarified only 
for the zero temperature dynamics of the p-spin spherical model : even if it is known that the TAP states having 
flat directions in the free energy landscape dominate the off-equilibrium dynamics, it is not clear why starting from 
a random initial condition the system goes toward these states. The dynamical TAP equations are strongly non- 
Markovian for any finite time. This result suggests that the matching between a certain initial condition (e.g. a 
random initial condition) and the asymptotic regime (slow dynamics at the threshold level) cannot be explained in 
terms of the static free energy and is a purely dynamical problem. 

We conclude noticing that the formal analogies (due to the superspace notation) between static and dynamic free 
energy let us hope that the study performed in this article can be extended also to the cases in which an analytical 
solution is not available (finite dimensional system), but the symmetry properties of the asymptotic solution are 
known p^ ]. We are currently working in this direction. 

Furthermore the dynamical TAP approach developed in this paper could be useful for the study of barrier crossing 
and instantons in the dynamics of mean field models . 
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APPENDIX A: INITIAL CONDITION 

We take as initial condition a fixed configuration {s°}; therefore in the Martin-Siggia-Rose functional (|2^) one has 
only to integrate on paths such that {si{t = 0) = s^}. We impose this constraint by adding to the action ( ^2|) the 
term: 



/ 



dt5{t)s,{t){sdt) - si) . (Al) 



This extra term has only two effects within the superspace formulation of dynamics: changes the operator D and the 
(super)magnetic field Hi in: 

D"' = -2-^-29^ + ^+5{t) , Hr=H,-S{t)s° (A2) 

This replacement does not affect the derivation of dynamical TAP equations; then taking care of the initial condition 
leads only to replace D with and Hi with H™ in the dynamical TAP equations (^ ) and (EO) . This corresponds 
to replace ^ with ^ -I- 5{t) in equations ( ^ ) and ( |45| ) and to add to equation ( ^ ) the term 6{t){mi{t) — s°). 
These new terms fix the initial condition on magnetisations: mi{t = 0) = and enforce the equality C(t, 0) — Q{t, 0). 
This last condition is already expected on physical grounds because the thermal noise is not relevant at time t — 0, 
therefore J2ti (MtMO)) = ^ti W> ^.(0). 
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We note that if we do not fix any particular initial condition, but we take as initial condition for the dynamical 
measure an uniform average over all possible configurations as in then we find that the local magnetisations, the 



spherical multiplier, the correlation and the response functions fulfil (^4|). ([45[), ( [46[ ) and (47) without the boundary 
condition on C. In this case the equations on the local on magnetisations are trivially satisfied because nii ~ for 
every time t. 

APPENDIX B: INM 

In this Appendix we show a standard way to compute the density of states of E: 

_ pjp - 1) ^ 

i-i^...=/^ip 

where {si(i)} is an instantaneous dynamical configuration. 

The spectral properties of E can be obtained through the knowledge of the resolvent G(/i + ie), that is the trace of 
((/i + ie)l-E)^i |||. Denoting the average over disorder by (•) and the average over instantaneous configurations 
at time thy (•), the mean density of states reads 



p{^- 1)^ lim Ini (G(/i + ie)) . (B2) 

The averaged resolvent is then written as the propagator of a replicated Gaussian field theory [^5| 

N 



G{ii + le) = hni jY[d$,J2 0fc (exp(i(s»(t), fi})) 



i k=l 
N . N . 

where i(s^(^), A^) XI + ~ J2 ^^.j^i ■ $j . (B3) 

2—1 ij — 1 

Replicated fields are n-dimensional vector fields attached to each site i. The average over the instantaneous 
dynamical configurations can be written in terms of Martin-Siggia-Rose functional | |3^ : 

N 

{exp{L{s^{t),fl))) = J Y[Vs^Vs^exp[L{s^,^l) + SMSR{S^,S^)] (B4) 



i=l 
n+oo N 



where we do not write the "ghosts" fields because we take the Ito convention. 

Within the Martin-Siggia-Rose approach the average over the couplings is a simple Gaussian integral. Then we find 
that the total action is equal to: 



i " f ds- \ 



"*"4iVP-i ^ 



where Oj^ is symmetric under the exchange of / and m and is equal to: 



(B6) 



OUit') - 6{t' ~t)Y, it') ■ ■ ■ (t'M s.,^, it') ■ ■ ■ (f) ■■■'^P (f) (1 < ^) (B7) 

a=l 

OU(O=0 l = m . (B8) 
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The action (B6) depends on Si,Si,4>^ only through 

N , N 



^(^' = ^ E «^ W^.(i') Rit, t') = i Eti ^^.(i') D{t, = ^ E (B9) 

i=l 1=1 
JV AT 

i=l 4=1 

In the large-N hmit the functional integral giving the resolvent G is dominated by a saddle point contribution. 

The action (B6) is invariant when one changes </) — > —0, therefore we take Ka{t) = and Ka{t) = 0. With this choice 

the saddle point equations on Ka(t) and Ka{t) are trivially satisfied. 

The saddle point equations on C{t,t'), R{t,t') and D(t,t') are the usual ones |^. 

Using the identity 



1 ^ ao 



4 = 1 



where << • >> means the average over s^, Si, (with weight exp(S')), it is easy to obtain the saddle point equation 
on Qa.b- 

1 

-p{p-l)C{t,t)P-^J2Qb,cQa,c-^{^i + ie)Qa,b-Sa,b^0 . (B12) 

c=l 

It is well known that in the computation of the density of states the replica symmetric saddle point gives the leading 
contribution. Therefore we take Qa.b = qSa.b- 

The spherical constraint fixes C{t,t) ~ 1, then from the saddle point equation on q we get q ~ 'At+V^pCp^^i) m ^ 
The density of states of E is obtained from (|B2|): 

t) ^ ^jR(g) ^ ^2pip - 1) - fi^ (B13) 

which is the Wigner semi-circle law. As expected this density does not depend on t. The only dependence on time 

m 



for the density of states of the energy Hessian comes from , which translates the centre of the semi-circle (see eq. 
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